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Summary 


The  research  in  this  project  is  aimed  at  three  broad  approaches  to  development  and 
assessment  of  psychomotor  and  perceptual  speed  ability  predictors  of  skilled  performance: 
The  first  approach  takes  advantage  of  computerized  touch-panel  devices  for  assessment  of  a 
series  of  psychomotor  abilities;  The  second  approach  links  individual  differences  in 
psychomotor  abilities  with  perceptual  speed  abilities,  which  have  been  shown  to  be  important 
predictors  of  the  acquisition  of  skilled  performance.  The  third  approach  evaluates  the  new 
test  batteries  for  predicting  individual  differences  in  complex  task  performance.  The 
program  of  research  is  proceeding  on-schedule,  in  that  the  touchpanel  technology  has  been 
acquired,  seven  new  families  of  psychomotor  tests  have  been  developed  and  subjected  to 
empirical  assessment,  and  perceptual  speed  tests  have  been  developed  and  incorporated  into  a 
larger  aptitude/ability  framework.  The  new  tests  show  substantial  promise  in  accounting  for 
important  sources  of  performance  variance,  and  are  currently  being  subjected  to  validation 
trials  for  complex  task  performance  criteria. 
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I.  Introduction 

The  research  in  this  project  is  aimed  at  three  broad  approaches  to  development  and 
assessment  of  psychomotor  and  perceptual  speed  ability  predictors  of  skilled  performance: 

The  first  approach  takes  advantage  of  computerized  touch-panel  devices  for  assessment  of  a 
series  of  psychomotor  abilities;  The  second  approach  links  individual  differences  in 
psychomotor  abilities  with  perceptual  speed  abilities,  which  have  been  shown  to  be  important 
predictors  of  the  acquisition  of  skilled  performance.  The  third  approach  evaluates  the  new 
test  batteries  for  predicting  individual  differences  in  complex  task  performance.  The  goal  of 
this  work  is  to  demonstrate  the  feasibility  of  using  new  technology  for  assessment  of 
psychomotor  abilities,  to  provide  an  integrated  approach  with  perceptual  and  cognitive 
abilities,  and  to  demonstrate  the  validity  of  new  measures  of  psychomotor  and  percepmal 
speed  abilities  for  prediction  of  complex  task  performance.  Potential  applications  from  this 
work  will  be  in  enhancing  prediction  of  human  performance  in  complex  skill  situations. 

II.  Current  Research 

Part  1:  Assessment  of  Psychomotor  Abilities  with  touch  panel  technology. 

This  part  of  the  project  involves  the  use  of  general  purpose  desktop  computers  and 
touch-panel  displays  to  generate  a  software  suite  that  assesses  individual  differences  in 
psychomotor  skills  and  aptimdes.  To  date,  we  have  developed  and  collected  data  on  the 
following  seven  test  types:  (a)  Tapping  Speed  and  Fitts’  Law,  (b)  Choice  Reaction  Time 
(RT)  and  Simple  RT,  (c)  Serial  Reaction  Time,  (d)  Maze  Tracing,  (e)  Mirror  Tracing,  (f) 
Maze  Pursuit,  and  (g)  Rotary  Pursuit.  The  tests  have  the  advantage  of  ameliorating  the  four 
main  obstacles  that  have  historically  prevented  wide-spread  use  of  psychomotor  testing, 
namely:  (a)  Fabrication  costs  (this  project  involves  off-the  shelf  equipment);  (b)  Calibration 
requirements  (the  new  technology  requires  minimal  time  and  effort  for  calibration);  (c) 
Examiner  training  (minimal  training  of  examiners  is  required,  given  the  simplicity  of 
operation  and  limited  needs  for  adjustment  and  maintenance);  and  (d)  Low  examiner-to- 
examinee  ratios  (because  the  systems  are  highly  self-contained,  and  include  on-board 
intelligence  for  upkeep).  The  test  battery  has  been  fully  developed  and  is  currently  being 
subjected  to  several  empirical  studies  to  demonstrate  reliability,  and  validity  (e.g., 
correlations  with  other  psychomotor  ability  assessments). 

Part  2:  Integration  of  perceptual  speed  and  psychomotor  abilities. 

Our  current  and  previous  AFOSR  projects  have  involved  an  extensive  investigation  of 
perceptual  speed  abilities,  including  the  development  of  a  taxonomic  representation  of  these 
domains.  In  several  smdies  it  has  become  clear  that  tests  of  complex  percepmal  speed 
abilities  are  important  predictors  of  individual  differences  in  learning  and  skilled 
performance.  From  a  theoretical  perspective,  these  investigations  are  important  because  they 
shed  light  on  a  domain  of  human  abilities  that  is  not  well-understood.  From  a  practical 
perspective,  this  work  has  demonstrated  that  substantial  gains  in  the  prediction  of  training 
success  and  performance  can  be  accomplished  by  the  proper  selection  of  appropriate 
percepmal  speed  measures.  For  example,  we  have  demonstrated  that  two  measures  in 
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particular  (a  variation  of  the  old  Army  Air  Force  Dial  Reading  Test,  and  an  FAA-inspired 
Directional  Headings  Test)  provide  substantial  incremental  validity  in  predicting  performance 
of  air  traffic  controllers,  both  in  the  laboratory  and  in  the  field.  Moreover,  our  empirical 
work  (Ackerman  &  Kanfer,  1993;  Ackerman,  Kanfer,  &  Goff,  1995)  has  shown  that 
complex  perceptual  speed  tests  also  capture  aspects  of  personality  and  self-regulatory 
processes  that  may  interfere  with  training  success  on  complex  skill  tasks. 

To  date,  we  have  developed  and  validated  a  large  battery  of  paper  and  pencil 
perceptual  speed  tests.  In  a  series  of  investigations,  we  have  validated  several  aspects  of  the 
proposed  taxonomy  of  perceptual  speed.  Specifically,  we  have  determined  there  are,  for 
most  practical  intents  and  purposes,  three  major  factors  of  Perceptual  Speed  (PS)  ability: 
PS-Scanning,  PS-Pattern  Recognition,  and  PS-Memory  (Ackerman  &  Rolfhus,  1996;  see  also 
Ackerman  &  Cianciolo  [1998,  “Psychomotor  abilities  via  touchpanel  testing:  Measurement 
innovations,  construct,  and  criterion  validity.”  Manuscript  under  review]).  By  integrating 
these  measures  with  the  new  touchpanel  psychomotor  ability  tests,  we  have  started  building  a 
broad  network  of  ability  constructs,  that  includes  cognitive,  perceptual  speed,  and 
psychomotor  abilities  -  all  clearly  relevant  in  one  way  or  another  to  predicting  individual 
differences  in  skilled  performance. 

Part  3:  Validation  of  Psychomotor  and  Perceptual  Speed  Abilities  for  Complex  Task 
Performance 

This  final  phase  of  the  research  project  is  under  way,  under  the  new  grant  to  Georgia 
Institute  of  Technology.  We  continue  our  research  and  development  efforts  on  the  touch- 
panel  psychomotor  tests,  and  will  be  validating  them,  along  with  the  perceptual  speed  ability 
measures  against  complex  task  performance. 

III.  General  Discussion 

This  is  clearly  an  ongoing  project,  and  this  “final  report”  represents  an  interim 
description,  roughly  two-thirds  of  the  way  into  the  program.  In  the  larger  context  of  the 
University  of  Minnesota  and  Georgia  Institute  of  Technology  grants,  we  are  on-schedule  and 
on-budget  for  completing  the  entire  project  described  in  the  respective  proposals. 

Moreover,  we  have  also  obtained  data  from  a  sample  of  School  of  Dentistry  students, 
including  criterion  training  performance  measures.  This  is  particularly  noteworthy,  because 
operative  dentistry  is  a  psychomotor-intensive  work  environment,  and  as  such,  provides  a 
directly  relevant  criterion  against  which  to  compare  our  new  touch-panel  tests.  We  have 
nearly  completed  data  analyses  on  this  project,  but  the  results  are  very  encouraging. 
Specifically,  we  have  demonstrated  significant  incremental  validity  with  our  touchpanel  tests 
in  predicting  individual  differences  in  operative  dentistry  skills  (over  and  above  a  traditional 
standardized  cognitive  and  spatial  ability  battery,  and  a  tailored  spatial  and  perceptual  speed 
ability  battery).  Such  results,  taken  together  with  the  other  data  we  have  collected  so  far, 
suggest  that  this  new  approach  is  promising  for  both  theoretical  and  application  purposes. 
Additional  information  will  be  presented  in  the  final  report  at  the  end  of  1998. 
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